A high-dimensional M-estimator framework for bi-level variable selection
نویسندگان
چکیده
In high-dimensional data analysis, bi-level sparsity is often assumed when covariates function group-wisely and can appear either at the group level or within certain groups. such cases, an ideal model should be able to encourage variable selection consistently. Bi-level has become even more challenging have heavy-tailed distribution outliers exist in random errors covariates. this paper, we study a framework of M-estimation for selection. This encourages through computationally efficient two-stage procedure. theory, provide sufficient conditions under which our penalized M-estimator possesses simultaneous local estimation consistency if nonconvex penalty functions are used level. Both simulation studies real analysis demonstrate satisfactory finite sample performance proposed estimators different irregular settings.
منابع مشابه
Regularized methods for high-dimensional and bi-level variable selection
Many traditional approaches to statistical analysis cease to be useful when the number of variables is large in comparison with the sample size. Penalized regression methods have proved to be an attractive approach, both theoretically and empirically, for dealing with these problems. This thesis focuses on the development of penalized regression methods for high-dimensional variable selection. ...
متن کاملPenalized methods for bi-level variable selection.
In many applications, covariates possess a grouping structure that can be incorporated into the analysis to select important groups as well as important members of those groups. This work focuses on the incorporation of grouping structure into penalized regression. We investigate the previously proposed group lasso and group bridge penalties as well as a novel method, group MCP, introducing a f...
متن کاملHigh Dimensional Variable Selection.
This paper explores the following question: what kind of statistical guarantees can be given when doing variable selection in high dimensional models? In particular, we look at the error rates and power of some multi-stage regression methods. In the first stage we fit a set of candidate models. In the second stage we select one model by cross-validation. In the third stage we use hypothesis tes...
متن کاملThe group exponential lasso for bi-level variable selection.
In many applications, covariates possess a grouping structure that can be incorporated into the analysis to select important groups as well as important members of those groups. One important example arises in genetic association studies, where genes may have several variants capable of contributing to disease. An ideal penalized regression approach would select variables by balancing both the ...
متن کاملVariable Selection for High Dimensional Multivariate Outcomes.
We consider variable selection for high-dimensional multivariate regression using penalized likelihoods when the number of outcomes and the number of covariates might be large. To account for within-subject correlation, we consider variable selection when a working precision matrix is used and when the precision matrix is jointly estimated using a two-stage procedure. We show that under suitabl...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Annals of the Institute of Statistical Mathematics
سال: 2021
ISSN: ['1572-9052', '0020-3157']
DOI: https://doi.org/10.1007/s10463-021-00809-z